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Abstract: We consider the phenomenology at the Large Hadron Colhder of new heavy 
vector-hke quarks which couple mainly to the third generation quarks via Yukawa inter- 
actions, with special emphasis on non-standard doublet representations which are less 
constrained from present data. We also discuss in detail the flavour limits at tree level and 
loop level and implications of a generalised CKM mixing matrix to these cases. 
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1. Introduction 

Heavy vector- like fermions are not present in the Standard Model (SM), however they 
naturally arise near the electroweak scale in many extensions of new physics. Flavour hier- 
archies among SM masses for fermions and their mixings are most often generated through 
their dynamical mixing with vector-like fermions. These particles are indeed present in 
many models of new physics, like for example extra dimensional, Little Higgs and dynam- 
ical models. More recently the possibility of gauging the Standard Model flavour group 
requiring anomaly cancellation with the addition of new vector-like fermions was studied 
with explicit model constructions which show the possibility of a relatively low new gauge 
flavour bosons scale Moreover, in this case the vector-like quarks play an important 
role both for anomaly cancellation and for the mechanism of generation of fermion masses 
(see for an example with left-right symmetry). The mixing of vector- like quarks with 
the other three generations and in particular the top quark is also a common feature in 
Little Higgs Q and composite Higgs models 0] based on top condensation Q. The Large 
Hadron Collider (LHC) is collecting data that allows to test and discover this sector quite 
soon. Typical cross-sections for pair and single production of heavy vector-like quarks are 
fairly large and within short term reach for the LHC experiments in the few hundred GeV 
mass range, as it will be discussed in detail in the following. Assuming some properties, 
the existing collider and precision data place limits on the new heavy quarks and set the 
lowest mass scale for these states. Direct searches, for example, give mass constraints in 
the 300 GeV range, assuming a charged current decay chain Q. In this work, we will focus 
on a particular example: namely, new coloured quarks that are doublets under the SM 
SU(2) symmetry, but with non-standard hypercharge. The resulting Yukawa couplings are 
less constrained by precision measurements than in other cases 0. Moreover, a fermion 
with such quantum numbers is present in models of composite Higgs boson with extended 



custodial symmetry |13|, engineered to protect the left-handed Zbb coupling from large 
corrections. In this model, the gauge symmetry is extended to SU(2)iX SU(2)/j in the 
bulk, and the left-handed top and bottom doublet comes in a bi-doublet of the two SU(2). 
The bi-doublet naturally contains a doublet with non-standard hypercharge. Moreover, 
the boundary conditions are such that the resonances from the non-standard doublet are 



parameterically lighter that the others 1 14 ] , therefore one can approximate the phenomenol- 
ogy of such models by the addition of a massive doublet only, after integrating out the other 
more massive resonances. 

The paper is organised as follows. In section § we describe the effective Yukawa 
interactions we consider for this study. We assume the presence of the SM quarks and 
of the standard Higgs doublet and couple them to the vector-like quarks. The Cabibbo- 
Kobayashi-Maskawa (CKM) flavour structure and the couplings to the standard gauge 
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bosons and Higgs particle are discussed in detail. In section ^ we discuss the electroweak 
precision tests and the tree level bounds which define the accessible parameter space. In 
section ^ we explore the loop effects in the Kaon and B meson sector together with loop 
effects on the couplings of the Higgs boson to gluons and photons. In section ^ we study 
the LHC phenomenology for the production and the decay of vector-like quarks with a 
detailed simulation of various decay modes obtained from single production of a heavy 
vector-like top partner. Finally we give our conclusions. Two appendices contain more 
detailed material concerning the expansion of the CKM matrix and the notations used for 
the meson mixing formalism. 

2. The effective interactions 

We assume that the new fermions interact with the SM fermions via Yukawa interactions, 
therefore the quantum numbers of the new fermions with respect to the weak SU(2)iX 
U(l)y gauge group are limited by the requirement of an interaction with the Higgs doublet 
and one of the SM fermions. A complete survey of all the possibilities is given in Q (see 
also Ip, for previous studies). Here we are interested mainly in the case of a new 
coloured fermion that transforms like a doublet of SU(2) with hypercharge 7/6, because 
the bounds are milder in this case. We will therefore introduce the notation in this specific 
case. In the quark sector, a SM family contains a doublet qi = {uL,dL}^ = (2, 1/6) and 
two singlets ur = (1,2/3) and cIr = (1,-1/3), that couple to each other via the Higgs 
H = (2,1/2). Here and in the following, L and R label respectively the left-handed or 
right-handed chirality of the field. The SM Yukawa couplings are: 

>C Yukawa = -Vu QlH^r - yd QlHcIr + h.c. ; (2.1) 

the up-type quarks (top), therefore, couple to the charge-conjugate of the Higgs boson. If 
we extend the SM with a new fermion -0 = (2, 7/6) = {X, U}^ , it is possible to write down 
a Yukawa coupling between the new fermion and the up-type singlets via the Higgs boson 
H. The Yukawa sector that we will consider here is 

Yukawa = -Vu QlH^'ur - A IplHuR - M i>L^R + h.C. 

= -y^uLUR - Ulur - M {UlUr + XlXr) + h.c. . (2.2) 

The new massive fermion contains a quark X with electric charge 5/3, and a fourth up 
quark which, however, has different gauge couplings with respect to the SM up quarks. 
The Higgs vacuum expectation value (VEV) v induces a mass mixing with the up quarks, 
therefore the mass eigenstates will be a mixture of the SM and new fermions. The new 
Yukawa couplings A connecting the heavy quarks with the SM ones will generate flavour 
mixing between the new states and the SM quarks in the up sector, while the down sector is 
left untouched. We will flrst review the simple limit of just one flavour mixing Q, in which 
the new state only mixes with the third generation: this is an interesting and physical 
limit because of the simpler notation and the fact that mixing with the light generations 
are much more tightly constrained. We will then give the more general parameterisation 
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of the full three flavour mixing, which will show a very peculiar flavour structure, which 
is not flavour minimal and still can be consistent with present bounds with non-negligible 
couplings. 

2.1 One flavour mixing 

In our previous paper we found that the most general mass terms, including the Yukawa 
interactions, is 

>Cmass = -rht ULUR - X Ulur - M UlUr + h.c. . (2.3) 

where rfit = ^= and 2; = can be chosen real thanks to a phase redefinition of U . It can 
be diagonalised by 



COS! 




— sin 


0^ 


sin( 


'u 


cos 6 


u 



(2.4) 



rht \ I cos 9^ sin 9^ \ I mt \ 
^ X M j y-sm9^ cosO^ j ~ y rrif, j ' 

and the relations between parameters and masses and mixing angles are |^ 

sine;^ = ^sin0^. (2.5) 



V(M2 - mIY + M2x2 



M 



We can however use those relations to express all parameters in terms of physical 
observables, like for example mt, mf and 



M = mx = \J ml + ml tan^ 9^ cos 9^ , (2.6) 

mmt' 1 mtmt' 
mt = ^ = , (2.7) 

2?,+m?tan2 0«^o^^« 



"^t' - oR _ - oB^ aR 



m^i + ml tan^ 9^ 



smt/„ = smt/ cosLy , 

mx 



sin 9^ = , tan 9^ = — sin 6^^ . (2.9) 

m2+m2tan2 0« 

In the rest of the paper we will use mf and 9^ as the two free parameters of the model, 
and the previous relations allows to calculate the fundamental parameters x and M. 

2.2 Three flavour mixing 

If we consider the three families of quarks in the SM, the Yukawa couplings become matrices 
in flavour space, while A is a vector. With explicit flavour indices i,j = 1, 2, 3, the Yukawa 
interactions are: 

-Cyuk = -v^ QIH'u'r - QlHd^R - A^' i^Liin^ • (2.10) 
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In the following we will describe a convenient method to diagonalisc the resulting mass 
terms. First, we can use the SM flavour symmetry to rewrite the standard Yukawa couplings 
as: 



y'u = diag(y„, Vc, yt) , 



Va = VcKM ■ diag(yd, Vs, Vb) ■ 



(2.11) 



The matrix Vckm is the misalignment between left-handed ups and downs and it would 
correspond to the Cabibbo-Kobayashi-Maskawa matrix in the absence of the new fermion. 
The tilde signifies that this is not the case, as we will see. After the Higgs develops a VEV, 
{H) = v/V^, the mass matrix for the fermions can be written (in this basis) as 




- {uL,CL,tL,UL) 



MXlXr + H.c. (2.12) 



where rhx = ^ and = For the down type quarks, the tilded masses are equal to 
the physical masses, as in the SM. For the up type quarks, there will be corrections coming 
from the mixing with the heavy U. Using the phase of U, we can show that M and one of 

the X, say X3, can be made real, while two physical phases are still present on xi and X2- 
This will be important for CP violation. In the following we will take X3 real, so that the 
formulas in the previous section can be used in this case without any change. 

The mass matrix for the up quarks M„ can be diagonalised by two unitary 4 by 4 
matrices: 



mt 



V 



■V, 



R ■ 



(2.13) 



mt' J 



Vl, that describes the mixing in the left-handed sector, is the unitary matrix that diago- 
nalises the unitary matrix 



Mu-Ml 



( 



~ 2 


















X2mc 








- 2 

mi 


xsfht 



\ 



(2.14) 



y xifhu X2mc xsrht + \xi\'^ + |a;2p + x\ j 



From this matrix we can see two things: a SM quark q = u, c, t is exactly massless in the 
limit rhq — t- 0, therefore the masses of the light quarks are always proportional to fhq; the 
mixing angles with the heavy t' are suppressed by rhq/M ~ mq/mf. 
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On the other hand, Vr, that describes the mixing in the right-handed sector, diago- 
nahses 



Ml ■ M, 



X2X1 fhl + \X2\ 
\ xiM X2M 



x^xs xIM\ 
X2X3 X2M 
ij + xl X3M 
xzM M2 J 



(2.15) 



Here we see that the mixing is only suppressed by the x's couphngs and that it is present 
also in the limit of massless SM quarks ifiq — )• 0. Therefore, it will be the couplings of the 
right-handed quarks to pose the most serious flavour constraints. 

2.3 Mixing matrices 



The two mixing matrices Vl and Vr can be calculated in an approximate way: we can 
assume that the parameters relative to the mass and mixing of the light two generations 
are small (therefore, m^, xi and X2 are of order e compared to m^, M and x^). We 
can then calculate the matrices in an expansion in e. A good trick is to first diagonalise 



the top-heavy fermion sector with the formulas in section |2.1| ; then, we can diagonalise the 
resulting matrix in the given expansion. 

For the right-handed matrix, the result, up to order e^, is: 



I 



1 



« / 



(m2 







(m2- 
1 - 



2mi 



cos 9ji + 



sindji 
mx 

mx 



(mp+m^)(|xi|'^+|z2r) cos Or sin^ Br 
2(m2,-m2)m2, 



(2.16) 



for i, j = 1, 2, 3; and 



-(^14 _ x]; cos gfl -r^24 _ cos gfl ^^34 _ . n 
- mx ' ~ mx ' ^R ~ ^ 



(m^i +m'- 



T/41 _ XI 

^R - ^ 



')(|xip+|x2p)cos^efl sindR 
2{m'j, —m'^)m'j^ 
.2\ 



t' ---tf-x 

T/42 _ X2 T/43 _ ■ a , {|a;i|^ + |a;2p)(3m2 -m2+(m2 +m2)cos26»fl)sinefl 



44 {|a;i|2+|a:2|2)(m2 -3m2+(m2 +m2)cos26»jj)cosefl 

= COS t^R * ■> jl-^ 

4:(mp—mf)m'^ 



(2.17) 



The masses, at order e^, are 



ml, 



2 ~ 2 
— 



C ) 

(kip + |x2p)mf 



t ■ 2 
- sm I 



m 



X 



m 



i,t' 



+ 



(|xip + |x2p)mf J, 



■ cos OJl . 



X 



(2.18) 



where nii^t and mi^j' are the top and top prime masses in the 1 generation case, Eq. (p.5|). 
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A similar procedure can be followed for Vl- 



( 



_ xlX2mcmu 

(m2-m2)m^ 

xi{m^, —m^)mu cos 0l sin^i X2(jn'^, —m^)mc cosOl sin^^ 



xlmu sm Uj^ 
^ 

x^rric sin^x. 



m: 



9 T" 



^5 T" 



COS 0i + (Nll^+l^2|>osg^sin^g^ 



(2.19) 



with = 1,2,3; and 



xlmu cos 



T/41 _ _ xiniu 



with mass eigenstates 



y.2 



x^mcCoseL y34 — _ (|a:iP+|j:2|pcos^^eL sin Ol 



1/43 _ _ gj^ _|_ (|a;ip+|x2p)cos^ 6>^ sin 9^ 



V^^ = COS 9l + (l^il'+l^2|^)cosg^sin^g,. 



ml = ml, ml = ml, 

2 2 I /I |2 I I |2\ ■ 2 /] 

"^t ="^i,t + (Fil +1^21 jsm t^L, 
m|, = rr?n, + + |x2p) cos^ 6'l . 



(2.20) 



(2.21) 



The expressions for the masses coincide with the ones found from the right-handed mixing 
once the relations between Ol and Or are taken into account. 

2.4 Charged gauge boson: couplings and CKM matrix 

In the basis we discussed above (gauge interaction basis), the couplings of the bosons 
is given by a 3 by 4 flavour matrix in the form: 

/I \ 



9 

V2 



[uL,CL,tL,UL) 



1 



\0 0/ 




+ h.c. , 



(2.22) 



where the new fermion U does not couple to the down-type quarks. In the mass eigenstate 
basis, the mixing in the left-handed sector will generate couplings with the heavy t' , and, 
in matricial form, the coupling can be written as 



9wL 



V2 



CKM 



( \ 

VcKM 

\^ 0/ 



(2.23) 



The upper 3 by 3 block, that describes the couplings of the standard quarks, is given by 
the matrix 



y-d _ y^3 



3 

1=1 



CKM ' 



(2.24) 
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that corresponds to the CKM matrix as measured by tree level SM processes. From this 
equation we can see that the measured CKM matrix is not equal to the misalignment 
between the two standard Yukawa matrices; however, this is approximately true because 
the mixing angles in Vl are small. The couplings of the heavy top to the SM down quarks 
is described by a 3-component vector 

j^^l'^KM- (2-25) 



yt'j 



1=1 



Note that in this model the 3 by 3 CKM matrix is not unitary. In fact 



^IcKM • y3,CKM 



§i3 _ y*.4i^4i 



L ' 



§i3 



^CKM ^CKM ' 



(2.26) 
(2.27) 



where we have used the unitarity of Vck m and . The violation of unitarity are propor- 
tional to the matrix elements V^* and to the couplings of the t' to the W . 

2.5 Neutral gauge boson: couplings and FCNCs 

In this model, the couplings of the will also develop off-diagonal terms, absent in the SM, 
therefore giving rise to tree-level flavour changing neutral currents (FCNC). Note however 
that the FCNCs will uniquely involve up-type quarks, therefore the strong bounds from 
Kaon and B meson mixing are avoided. Nevertheless, as we will see, the measurements in 
the D meson sector are yet constraining. Let's first recall that the couplings of the Z to 
SM up quarks are proportional to ^ (^ — \s^/) for a left-handed up, and ("I^vf) 
a right-handed up (where as usual sw and cw indicate respectively the sine and cosine of 
the Weinberg angle); while for the new U quark the couplings are proportional to 

^M_2^ 
V 2 3 

for both left- and right-handed components. In terms of interaction eigenstates, the left- 
handed couplings of the Z can therefore be written as 

/I \ 



w 



(2.28) 



cw 



{uL,CL,tL,UL) 



%2 



1 



1 



\ 



1/ 



V 1/ 



r 



CL 
tL 

\UlJ 



In the mass eigenstate basis, the coupling becomes 

g ll 2 



yzL — I o o^w 



Cw 



(2.29) 



where I, J = 1, 2, 3, 4. Again, the flavour violation is governed by elements! Analo- 
gously for the right-handed couplings we obtain 

2 

cw 



9¥n 



2cw ^ 



(2.30) 
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2.6 Higgs boson couplings 

Finally, for the Higgs, in the interaction basis 

/ rhu 



1 



Ch = - {uL,CL,tL, Ul) 



\ 

rhc 
rht 

V Xi X2 X3 M j 



M 



( \ 



\ 1/J 



CR 
tR 



(2.31) 



The first term reproduces the mass matrix, therefore it will be diagonal in the mass eigen- 
state basis: the flavour violation is generated by the second term with an entry only in the 
44 term, similar to the Z couplings. In the mass eigenstate basis the coupling reads : 



IJ 



C 



3. Tree level bounds 



\ 



rrir 



*,4Ij/4:J 



R 



(2.32) 



The inclusion of a non-standard doublet of quarks generates a richer flavour structure than 
the SM one: we have seen a non-unitary CKM matrix and flavour violating couplings 
of the Z and Higgs in the up sector. In this section we discuss tree level bounds on 
the new parameters, mainly coming from electroweak precision tests at accelerators, low 
energy observables as the weak charge of atoms, and flavour bounds coming from D meson 
processes. Due to the absence of modifications of the coupling of the down quarks to the Z 
and Higgs, therefore the absence of FCNCs in the down sector, the precise measurements 
in the Kaon and B meson sector do not pose very tight bounds. Such bounds may arise at 
loop level, via the modification of the CKM matrix and the new CP violating phases, and 
these effects will be briefly discussed in the next section. 

3.1 Precision electrovi^eak measurements 

In 10] we imposed the bounds on the top sector from precisely measured quantities in the 



SM. For earlier bounds see for example [10|, [11|. The deviations on the Zbb coupling at 
tree level are absent in this specific case. We have used the exact formulas in [^] to check 
that the one-loop contributions to the Zbb coupling are present but small for our non- 
standard doublet. Note that this is true for our specific non-standard doublet, while for 
other cases, as for example a singlet, these bounds are relevant. We studied the deviations 
in the Wtb couplings allowing at most a 20% deviation from 1, electroweak precision tests 
(in particular the T parameter) where we allow —0.1 < T < 0.4 (here we assume nih = 120 
GeV and vanishing S and U), finally the direct bound from Tevatron. The latter bound 
is nominally at 311 GeV, however the experiments only look at the t' — t- Wb decay mode, 
therefore we pose the bound until the branching ratio drops significantly below one: in 
other words, the bound is valid for mf < 290 GeV. In the left panel of Figure |l], we show 
the allowed regions in the m^z-sin^^ parameter space. Note that the upper region on the 
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Figure 1: Bounds on the top mixing as a function of toc and sin 6'^. In magenta Wtb, in green 
Zbb, in black the direct bound from Tevatron, in blue the bound from the T parameter. The grey 
lines correspond to fixed values of AI — mx- The light blue areas are the allowed regions. On the 
right panel, we show the bounds from CMS in the trilepton channel and Wb channel. The dashed 
lines correspond to the case of a decoupled Higgs, the solid lines to ruh = 115 GeV. The coloured 
areas are the allowed regions. 

right corresponds to value of the A Yukawa coupling close to the non-perturbative region, 
therefore non-perturbative effects should be considered and the formulas we use are not 
reliable in the upper right corner of the left panel in Figure ||. 

3.2 Direct bounds at the LHC (CMS) 

The CMS collaboration recently published new bounds on a heavy t' with the 2011 data 
collected by the LHC. They consider both the channel Wb and the channel Zt, in both 
cases assuming pair production and 100% branching ratios. Here we will use their results 
to pose bounds on our case, where all decay channels are open. 

For the tZ channel [|l^ , they select events with a pair of leptons (electrons or muons) 
near the Z mass (the window for the dilepton invariant mass is set between 60 and 120 
GeV), one additional lepton and at least two additional jets. Their analysis is limited to 
a counting experiment and the bound is extracted by comparing the expected number of 
events from backgrounds and signal to the observed one: the preliminary results, based on 
an integrated luminosity of 191 pb~^ shows that there are no events in the dataset. In our 
case, many different decay chains can give rise to events that pass the event selection used 
by CMS: 

pp {t' Zt){i' Zt)^ bbZZW+W- 
{t' Zt){i' W+b) bbZW+W- 
{t' W'b){t' ^ Zt)^ bbZW+W- 
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{t' Zt){t' ht) bbbbZW^W 
{t' ht){F ^ Zt)^ bbbbZW+W~ 

where one of the Z's and one of the W^s decay leptonically. In extracting the bound, we 
consider all these channels together, under the assumptions that the efficiency of the cuts 
is the same: this is not necessarily true, because the kinematics of the event are different, 
and we plan to refine this analysis in a future work. The final result is shown on the right 
panel in Figure ^ the dark green area is excluded for a Higgs mass of nifi = 115 GeV, 
while the lighter green one is excluded in the decoupled Higgs limit, where the absence of 
the tH decay mode boosts the tZ branching. 

The analysis in the Wb [^] is more refined because of the presence of an irreducible 
background from tt: the selection criteria are the presence of an isolated lepton (electron 
or muon), a missing pT greater than 20 GeV, at least 4 jets where one or more are tagged 
as b-jets. To distinguish the ti background, the collaboration reconstructs the invariant 
mass of the top or t' under the assumption of the topology 

pp {t/t' W+b){i/i' W'b) bbl^u jj , 

and fits the distribution of backgrounds and signal with a free mass for the t' . In the 
preliminary results, an integrated luminosity of 573 pb~^ for electrons and 821 pb^^ has 
been considered. In our case different decay chains can give rise to events that pass the 
selection rules of this analysis. However, the reconstruction algorithm will not work on 
events with decays to Zt and ht, where two extra jets or missing energy is coming from the 
decay of the Z and h. A more detailed study would be required to take into account such 
events. To be conservative, therefore, we will limit ourselves to rescale the limit by the 
branching ratio BR(t' — )• Wb): the result is shown in Figure |l], where the dark (light) grey 
area correspond to a Higgs mass of m/j = 115 GeV (1000 GeV - decoupled limit). Note 
that for low sin^/j, the bound is mf > 290 GeV, which is the same bound we assumed for 
the Tevatron data and given by the suppression in the Wb branching ratio. 

The plot also shows that the Zt or trilepton channel is much more promising than 
the more traditional Wb one, also taking into account the more limited luminosity of 
the preliminary data. Note also that a trilepton signature will also arise the from single 
production of t', as we will discuss in Section ^, and that such events are not taken into 
account in extracting this bound. 

3.3 Dq—Dq mixing and Dq — )■ decays 

In our model, FCNCs will only affect the up quark sector, therefore the most severe bounds 
will come from the D meson sector. The most recent experimental measurements in the 



Dq-Dq mixing (with no CP violation) are |17] 



Amp f.-, f^p,+o.oo24 „, _ nn7fi+o.oon (o -,\ 

XD - - ^•UlUO_o.oo26 ' VD - ^jT^ - U.007b_o go^g . (3.1) 

In the SM, xp is dominated by long distance effects, and its value cannot be reliably 
estimated. Therefore, it is possible that the new physics saturates the experimental value 
and this situation will provide the most conservative bound on the new contributions. 
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Another potential bound may arise from the dilepton AC = 1 decays: these channels 
have not been measured, and the present experimental limits are 

Bi?(Do ^ e+e-)cxp < 1-2 X 10"^ Si?(Do ^ ^^Ai")oxp < 1-3 x 10"^ (3.2) 

Contrary to the AC = 2 contributions to the mixing, the branching ratio can be calculated 
and, in the SM, one obtains 

5i?(Z)o^/iV")sM~3x 10-13^ (3.3) 

while the decay into electrons is suppressed by the electron mass square. In both cases, 
therefore, the SM prediction lies well below the experimental limit. 

In our case, the contribution of new physics is given in both cases by a tree level 
exchange of a Z boson in the s-channel: 

cu ^ Z* uc, and cu — )• Z* — J- l^l^ . (3.4) 

We will only consider the right-handed couplings, because the left-handed ones are sup- 
pressed by extra powers of the light quark masses. The contribution of the new physics 
can be written as: 

= ^^^^lrim^,mz)igWR? , (3.5) 
2m^L £) 6 



SBRiDo m-) = 1 - '4- i&f . (3.6) 

Szirm^L n y mf) cos^ Ow sm^ dw 

where the explanation of the formula and the definitions and numerical values of the various 
parameters can be found in |[T7| ]. If we assume that the new physics saturates the value 
of xd, we can predict the value for the branching ratio; this value will become an upper 
bound in the case in which the mixing is dominated by the SM: 



Plugging in numbers, at one sigma, we find 

BR{Do ^J.~^^l~)NPh = (0.8 ± 0.2) X 10"^° , (3.8) 

therefore we are still far from the experimental bound. For electrons, the branching is 
suppressed by a factor (me/m^)^. 

The most significant constraint from new physics, therefore, comes from xd- In our 
case, 

te)^ = wmv^r . (3.9) 

cos^ Ow sm Ow 
To fit the experimental value would require 

\V^'\\V^'\ = 2.Ut',ilxW-^. (3.10) 
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This implies a bound at 3cj ^ 



\Vr\\V^^\< 5.2x10-'^. (3.11) 
As we will see in the following, this is the most stringent bound on flavour violation. 
3.4 Rare decays of D mesons 

Many rare decays of the D mesons via FCNC have been tested and have strong bounds 
from experiments such as CLEO and BES. In the SM they are loop generated and of- 
ten dominated by long distance effects while, in our model, they may receive tree level 
contributions from the Z exchange. A list of the experimental limits 0], standard model 



predictions from short and long distance [19| calculations and the possible contribution in 



our case is presented in Table |l|. The short distance SM result is dominated by the operator 



Og [2C 



V2 ^''^""Utt' 



C = eg u-i^'PLch^l , (3.12) 



where cg{'mw) ~ I ^^S ^ — 1-34, while the contribution of the penguins, enhanced by 
QCD corrections is small. 

In our model, the right-handed couplings of the Z generate the operators Og and 
0[q [^], with coefficients 

jr = ^y^^^Vf urPRC {(1 - 4sin2 ew) Hi - . (3.13) 

Those operators contribute to the short distance term, they do not significantly affect the 
long distance one because the pair of leptons comes from an heavy Z boson that do not mix 
significantly to light vector mesons. The main difference between our contributions and the 
SM one is that in our case right-handed quarks are involved, and the form factors are not 
precisely known. Here we will simply assume that the form factor for right-handed and left- 
handed quarks are the same to extract an order of magnitude estimate of the contribution. 
Under such assumption, we can calculate the ratio between the new physics and SM 
contribution (where the form factors cancel out) and obtain 

(o = ''^'''"t|'''|tVr'""V jT|V-;i¥ = 0.5 X 100 X Wmvir . (3.14) 

This enhancement factor allows some of the bounds to be relevant for our model. However, 
imposing the Dq-Dq mixing bound, we obtain that 

eD<0.05, (3.15) 

therefore those processes should not impose further bounds. 



^This bound roughly agrees with the results in jisj, where effective operators are considered. The relevant 
parameter, as defined in [|l^, is \zi\ < 5.7 x 10^^ ( I'lfeV ) ' ^^^'^^ ^ ^® scale suppressing the operator 
(A = mz in our case). Converting the bound in our parameterisation, we obtain \V^^\ |Vh^| < 2.0 x 10~*. 
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TV^ /~\ /H /"^ 

lilUQc 


SM short 




our model 


tJXp. llllilL 


7~l+ > + + — 


9.4 X 10" 


-9 


1.0 X 10 


c 


^ n/+/- 


7.4 X 10 


r^-f- 4- 4- — 

—?- TT^fl^fl 


9.4 X 10" 





1.0 X 10"^ 


c 


^ n/+/~ 


3.9 X 10"^ 




4.8 X 10" 


n 

-y 


1.5 1.8 X 10 


c 


ui+r 


5.6 X 10"^ 


Do 77 










l-loop 


2.7 X 10"^ 


7-\ -1- — 

Dq TT^e+e 


1.9 X 10" 


-9 


2.1 X 10"'' 


c 


ul+l- 


4.5 X 10"^ 


L>o ^ 7rV+/i 


1.9 X 10" 


-9 


2.1 X 10"'' 


c 


ui+r 


1.8 X 10"^ 


Vo — ^ 776^ e 


2.5 X 10" 


10 


4.9 X 10"^ 


c 


ul+l- 


1.1 X 10"'^ 




2.5 X 10" 


10 


4.9 X 10"^ 


c 


ul^l- 


5.3 X 10"'^ 


T -V _L _ _J_ _ 








c 


ul+l- 


3.73 X 10 * 


Do p^e^e 








c 


ul+l- 


1.0 X 10"^ 


Dq —7- TT^TT fl^fl 








c 


ui+r 


3.0 X 10"^ 


T-\ OA- — 

Do p'^fi+fi 


9.7 X 10" 


10 


3.5 4.7 X 10 ' 


c 


^ ul+l- 


2.2 X 10"^ 


Do — )■ oje^e 








c 


ui+r 


1.8 X 10"^ 


Do —7- ujpr p, 


9.1 X 10" 


10 


3.3 ^ 4.5 X 10"^ 


c 


ul+l~ 


8.3 X 10"^ 


Do — ^ K+i^'e+e" 








c 




3.15 X lO""' 


Dq — 0e^e 












5.2 X 10 










c 


ul+l- 


3.3 X 10"^ 


Dq (pp^P 







6.5 9 X 10 " 






3.1 X 10"^ 


i^o — ^ vr iv e e 












0.00 X iU 


Dq — )■ -K^K^ p'^p^ 












3.59 X lO"'' 


Do — )• TT^ TT~ TT^ e'^ 








c 


ui+r 


8.1 X 10"^ 


Dt ^ if 


9.0 X 10" 


10 


4.3 X 10-s 


c 


ui+i- 


3.6 X 10"^ 




9.0 X 10" 


10 


4.3 X 10"^ 


c 


ui+r 


1.6 X 10"3 


L>+ ^ E:*(892)+Ai+Ai" 


1.6 X 10" 


-9 


5^7 X 10"' 


c 


ui+r 


1.4 X 10"3 



Table 1: Rare decays of D mesons with SM short and long distance contributions, the decay 
channel within the vector-like model and the corresponding experimental figures. 



3.5 Top quark FCNC rare decays: t —?- Zc, Zu 

FCNCs mediated by the Z boson can also affect the physics of the top quark. The only 
observable effect is in rare decays of the top quark: t — t- Zc and t — >• Zu, which are very 
suppressed and induced by loops in the SM. The present bound on the FCNC decays of 
the top is 0: 

T{t^Zc) + T{t^Zu) ^^^^ 

r(t ^ wh) < '-'^^ ' 

which involves the partial width in Wh that has not been measured yet. In our case, there 
is a tree level vertex of the Z with top and a light quark. The widths can be written 



as [22, |2^ (neglecting the up and charm masses) 

,3 



nt ^ Zq) = {g'^nf^f {—] > (3-17) 
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where 



In our model, 



/(x) = (1 + 2x2). (3.19) 



and similarly for t — )• Zc with V^^ — )• V^^- 
The bound, therefore, can be written as 



2|V»P f(mw/m,) 
and 



Note that this bound depends on ~ sin^^, and on the value of Vtb which can deviate 
from one and therefore make the bound stronger. Even though this bound is much milder 
that the one from the Dq mesons, the different dependence on the two mixing angles V^^ 
and makes it relevant. These rare decay modes of the top quark may be relevant for 
LHC with high statistics and can be studied in detail at an electron-positron linear collider. 

3.6 Atomic Parity Violation 

Another strong bound comes from the modifications of the couplings of the up with the 
boson: experiments can measure the weak charge Qw of the nucleus. The most precise 
test is from atomic parity violation in Cesium ^^^Cs |^]: 

Qiy(^^^Cs)|^^p = -73.20 ±0.35, QvK(^^^Cs)|gj^ = -73.15 ± 0.02 . (3.23) 

In general, the weak charge can be written as [24 

Qw = {2Z + N){rzL + 9zr) + {Z + 2iV)(ML + , (3.24) 

where the ^'s are the left- and right-handed couplings of the Z^ divided by a factor 2cose;y ' 
and N and Z are the number of neutrons and protons in the nucleus. In our case, the only 
large deviation appears in 

5|^ = -^sin2 0H/ + 59zij, 8gzR = -\Vk^\^ ■ (3.25) 
The correction to the weak charge is therefore 

5Qw{Cs) = -{2Z + A^)|V^^P = -188|y^^p , (3.26) 
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Dq-Dq mixing 


\yR\\yR\ < 3-2 X 10-^ 


APV in Cs 


IV^^I < 7.8 X 10-2 


LEPl, charm couplings 




Tevatron: t — )• Zc, Zu 




D meson decays 


none 



Table 2: Bounds on \V^^\ and |V^^| in order of importance. 



where the numerical value corresponds to ""^^^Cs {Z = 55 and N = 78). As the SM 
prediction is in very good agreement with the experimental value and its error is very 
small, we can directly compare the new physics contribution to the experimental error. At 
3 Sigma \5Qw\ < (-73.15 + 0.06) - (-73.20 - 1.05) = 1.16, therefore 

IV^^I < 7.8- IQ-^ (3.27) 

Atomic parity violation has also been measured for the Thallium ^'^^ Tl, however the 
bound is milder ^ 

3.7 Measurement of the charm couplings at LEPl 

The couplings of the charm quark to the Z boson have been precisely measured at LEPl [25|. 



Under the hypothesis of universal lepton couplings, the result of the fit is 

g^ZL = 0.3453 ± 0.0036 , g^zR = -0.1580 ± 0.0051 . (3.28) 

In our case, the largest correction occurs on the right-handed couplings, and requiring that 
the new contribution is smaller that 3 standard deviations yields 

^ 'Vr^P < 0.015 => \V^^\ < 0.2. (3.29) 



2 cos dw 



This bound is stronger that the bound from top decays in Eq. 3.22. Note also that no 
significant bound can be extracted from the couplings of the up quarks, which are measured 
with a much worse precision, while the couplings of the top have not been measured. A 
summary of all the relevant bounds on \V^^\ and \ V^'^\ is presented in Table |2|. 

3.8 CKM Matrix 

The CKM matrix has been measured very precisely, both at tree and one-loop level. Even 
though in our case the corrections are proportional to the suppressed mixing angles in the 
left-handed sector, it is worth studying the detailed structure of the modified CKM matrix 



^This case is more favourable because of the larger atomic immber {Z — 81 and TV — 123), however the 
experimental precision is lower that in Cesium Q: 

Qw{Tl)l^p. =-116.4 ±3.6, Qw(Tl)|g^, = -116.76 ±0.04; 

for which the correction is 5Qw(Tl) = -{2Z + N)\VRf = -285|V^^p , and the bound \Vr\ < 0.19 . 
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to ensure that no further bounds arise. In the fohowing we will limit ourselves to tree 
level measurements, because loop effects will also include the effect of the heavy top t' and 
the flavour violating Z boson couplings (a brief discussion of loop effect is present in next 
section). The modified CKM matrix is given in Eq. ( p. 24 ): as Vl is close to the identity 



matrix, we can assume that Vckm is approximately equal to the measured matrix, while 
Vl generates small corrections. For a study discussing the CKM structure in the case of 
an iso-singlet see |26]. In this section, we will estimate how small such corrections can be. 



We first observe that both Vckm and Vl are hierarchical matrices, as the off diagonal 
entries of the latter are suppressed by ratios of quark masses. Therefore, we can use the 
Cabibbo angle A = sin0i2 as an expansion parameter for both (knowing that ^ ~ O(A^) 
and ^ ~ OiX')). More details about this expansion are presented in Appendix On top 
of the suppression from the light quark masses, off diagonal Vl terms are also suppressed by 
the new yukawa couplings Xi , which are constrained to be small as we discusses previously. 
One can relate the elements of Vl that enter in the definition of Vckm to V^ and V^, 
and use the bounds in Eq.s ( ^HD , (|]2|) and ( |337D to find an upper bound. For instance 



T/12 _ I^CIT^U X1X2 _ rricmu -,,*,4lTr42 _ T/*,21 /q qp,N 



Therefore, jV^^I = \ V'l}\ is suppressed by a power from the quark mass ratio, but also 
by the product |Vr^||Vr^| < 3.2 • 10-"^: 

I I < 8,3 . 10-7. (3.31) 
Therefore, V^^ is always highly suppressed! Regarding V^^ and V^^, we can write 

Vl' = -:%sin0, = _^-A^ = ^V*/\^ea. (3.32) 
mf nit mx rrit 

Besides the A^ suppression from the quark masses, this element is proportional to \ V^^\ < 
7.8 • 10"^ (from APV in Cesium); therefore, considering sinOji < 0.3 as a conservative 
bound, we find 



l^^^l < 4.2 • 10"^ (3.33) 



The same is true for 



n2 ^2 



Finally, 



V-f = ^^^^^cos^i(-y;'^3). (3.34) 



= Gl = = — Vo' sm Or . (3.35) 

mf mt mx rnt 



This element is proportional to V^ , therefore it is maximal when the bound from the 



charm couplings in Eq. |3.29| is saturated: 

\Vl'\ < 2.3 • 10-3 X |V^2| _ 4 g . iQ-4 _ (3_3g) 
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The same is true for 

,2 



32^m^_m,^^^^ 23^_ (3.37) 

m 



The final comment is about V^'^: this modifies the top coupHngs and therefore may 
seriously affect the loop processes that are Glashow-Iliopoulos-Maiani (GIM) suppressed in 
the SM. The tree level bound coming from modifications of Vtb have already been considered 
in 0, and are less competitive than bounds from the T parameter. We can estimate 



1 2 

~ cos = 1 - - ^ sin2 Or (3.38) 

2 ni ^ 

The bounds from the top sector typically imply mx > '^rnt and smOn < 0.3, therefore 

l-Vl^ < 0.01 . (3.39) 

A numerical example 

We have seen that corrections to the CKM matrix are typically very small. To be more 
concrete, here we will focus on two numerical examples to illustrate the relevance of the 
corrections. First, we parameterise the two phases as xi = \xi\e^l^^ and X2 = |x2|e*^^. As 
a benchmark mass for the t' we consider m^/ = 350 GeV, and a conservative bound on the 
mixing sin^^^ = 0.3. As we want a maximal flavour violating effect, we will saturate all 
bound, in particular the strongest bound from Dq-Dq mixing = 3.2 • 10~^. We 

distinguish two cases: in case A, the mixing with the up is maximal, therefore from the 
APV bound we fix \V^^\ = 0.078; in case B, we require maximal mixing with the charm, 
which is bounded from the charm couplings | V^^| = 0.2. In these numerical examples only, 
for simplicity, we also set the phase in Vckm to zero, while the absolute values of the 
entries are taken from the tree level measurements in the SM [^. The final results are 
listed in Table ^ 



4. Loop constraints and couplings 

So far, we have discussed tree level bounds from precision and flavour observables coming 
mainly from the right-handed mixing of up type quarks, while the left handed mixings are 
suppressed by the SM quark masses. In particular, the CKM matrix is only affected by 
the left-handed mixings and no significant tree level bounds arise. The situation is quite 
different at loop level: in fact, loops involving the modified CKM couplings, will correct 
the SM results. In some cases, where a precise cancellation occurs in the SM loops, even 
small corrections may give rise to observable effects. Another important constraint may 
come from CP violating effects, which arise in the SM from a single phase. In our case, 
there are two extra phases in the game. Moreover, even if the extra phases are small, 
the mixing with the t' will change the phase structure of the CKM matrix and new CP 
violating effects may arise. In the following we will focus on the two most constraining 
cases: AF = 2 mixings in the Kaon and B meson sectors. 
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SM 


Case A 


Case B 


T/Ud 

^CKM 

^CKM 
yub 


0.974 
0.225 
0.0039 


+ 1.9 • 10-'^ e*('^2-^i) + 2.6 • 10-9 e-*'3i 
+8.5 • 10-'^e*('^2-/^i) + 1.2 • 10-** e-^'^i 
+3.4 • 10"** e^('^2-'^i) + 2.7 • lO-^e"*'^! 


+1.9 • 10-^ e*(/32-/3i) + 5_4 . 10-11 e-*ft 
+8.5 • 10-V('3^-'^i) + 2.5 • 10-1" e-*^i 
+3.4 • 10-** e*(/32-/3i) + 5_6 . IQ-^e-'f^^ 


^Skm 

T/CS 

]/cb 
CKM 


0.23 
1.023 
0.041 


-8.1 • 10-7e-'(^2-^i) + 5.8 • 10-8 e-'l^^ 
-1.9 • 10-^e-*('52-^i) + 2.6 • lO-'^e"*'^^ 
+6.1 • 10-6 e-*^2 - 3.2 • 10-9e-*('52-'^i) 


+2.8 • 10-6 e-"^2 - 8.1 • 10-7e-'(^2-^i' 
+1.3 • 10-5e-*'^^ - 1.9 • 10-'^e-*(^2-'3i) 
+3 • 10-4 e-"^^ - 3.2 • 10-9e-^('^2-^i) 


Ytd 
^CKM 

^CKM 
Ytb 


0.008 
0.038 
0.88 


-1 • 10-4 - 2.1 • 10-6 e'^^ - 4.1 • lO-'^ e'^^ 
-4.6 • 10-4 - 1. • 10-5 e'f'^ - 1. • 10-^ e^'^i 
-0.01 - 3.8 • lO-'^ e*^^ - 1.6 • 10-^ e^^^ 


-0.9 • 10-4 - 1.0 • 10-4 e"^^ - 8.4 • 10-^ e'^^ 
-4.2 • 10-4 - 4.7 • 10-4 e'l^^ - 1.9 • 10"^ e^^i 
-0.009 - 1.9 • 10-5 e*''^ - 3.3 • 10-" e'^' 


yt'd 

yt's 

yt'b 
''CKM 




0.0013 + 3.4 • 10-6 e'^^ + 6.5 • 10"^ e'^^ 
0.006 + 1.5 • 10-5 e'^^ + 1.5 • 10-^ e'^^ 
0.14 + 6.1 • 10-^ e'l^'' + 2.6 • 10-^ e'^i 


0.001 + 1.7 • 10-4 e*^2 + 1.3 • 10-** e'l^^ 
0.006 + 7.4 • 10-4 e*^^ + 3.1 • 10-^ e'l^^ 
0.13 + 3.0 • 10-5 6'^*^ + 5.3 • 10-" e'^i 



Table 3: Numerical values of the corrections to the CKM matrix for nit' = 350 GcV, sin6'j^ = 0.3, 
3.2 • 10-4 and: in case A, IV^^I = 0.078; in case B, 1^421 ^ o.2. 



u, c, t' 



u, c, t, t' 



u, c, t' 



^AAAA; 



u, c, t. t' 



Figure 2: Box diagrams contributing to — mixing. 



4.1 Kaon sector: K*^ — mixing 

The — mixing can be calculated in our model with extra non-standard doublet by a 
simple generalisation of the SM formulas, by including the effect of the t' quark as shown 
in Figure In fact, loops involving the flavour violating couplings of the are irrelevant 
because they only involve up-type quarks. The general formalism to describe such mixing 
is presented in Appendix^: here we will limit ourselves to report the most relevant results. 
In the non-SM doublet case, the non-diagonal mass matrix element M12 between and 
mesons can be written as 

M,2 = \flBKmK% ^ VijeeEix,,x,), (4.1) 

3 V2 47r sm^ dw ■ „ 

l,J=C,t,t' 



where the Inami-Lim functions E |27] of the mass ratios Xi = m^/m^ are defined in 
the Appendix, and the coefficients ^* contain the CKM mixings generalised to include t': 
= ycKM^CKM^ with i = u,c,t,t'. The factors rjij encode the QCD loop corrections to 
the electroweak loop diagrams. The condition V^^j^,^ ■ Vckm = 1 in Eq. ( p.27 ) implies the 
quadrangle condition ^" + + ^* + = 0, therefore one can eliminate the contribution 
of the up quark loop as in the SM calculation. The functions E are strongly dependent 
on the value of the masses, and in particular they grow with the mass of the fermions 
in the loop: to quantify this statement, we list the values of the relevant functions for 
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mf/ = 350, 500, 1000 GeV: 



E{xc, Xc) = 2.5 X 10^^ , E{xc, xt) = 2.2 x lO^^ , E{xc, Xf) = (2.4, 2.5, 2.6) x 10"^ , 
E{xt,xt) = 2.5, S(xf,XfO = 4.0,4.8,6.4, S(xf/, Xf/) = 7.5, 13, 44 , (4.2) 

while the function depending on Xu are neghgible. Here we are interested in two observables: 
the mass difference Atuk between the two mass eigenstates and the CP violating parameter 
ex, given by 

ArriK = rriKi^ - rriKg = 2ReMi2 ~ 2|Mi2| , (4.3) 

gi7r/4 

ex ^ -7=- ImMi2 . (4.4) 

They are to be compared with the experimental results @ : 

ArnxUp = (3.483 ± 0.006) x lO^^^GeV , and |ei^|exp = (2.233 ± 0.015) x 10"^ . 

The real part of M12, that is related to Amx, is dominated by the charm contribution: in 
fact, the suppression from the function E is compensated by the suppression of the CKM 
mixing for top and t' , therefore 



Atuk ~ 1.75791 x 10 



-10 



{V:,V,d)''E{xc, X,) - 2.1 X 10-15 GeV . (4.5) 



The corrections to from the new mixing are very small, therefore no significant modifica- 
tion occurs. The situation is rather different for €k- In this case, in the SM the imaginary 
part of is of the same order as the imaginary part of therefore ex is dominated by 
the top contribution. Effects of the new physics enter either via modifications of the top 
couplings and via the new phases, so we can expect large modifications in this case. In 
addition to the proportion of the short and long distance contributions in measured 
values are also important. Compared with the short distance contributions, in the real 
part of M12 the long distance contributions are sizable effects, but in the imaginary part 
of M12 they are negligible. In other words, ex is more sensitive to the new physics effects 
than the mass difference Amx- The non-diagonal mass matrix element M12 of top- and 
i'-mediated box diagrams in the vector-like model can be approximately written as 

Mto nqT^/ X „m?sin^' 



iV*Vt,f\ E{xt,xt) + 2!^^^^^ (E{xt,x,) - E{xt,xt)) 



H 4 E{xt',xt' 

+ {V:,Vu)'^\V^'\sinen 



X \^e'^^{V:,Vcd)E{xt,xt) + e-'^^{V:,Vtd) (^E{xt,xt) + 2^E{xt,xt'ij | 



,(4.6) 



q2 

where Ck = y^fny^mKfKBK and E{xi,Xj) = r]ijE{xi,Xj). The contributions from 
i'-mediated diagrams with heavy t' are suppressed by its mass and these effects become 
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sub-leading terms. The /3i term is only appear in Consequently, the result is practically 
independent of /3i while it can be modified slightly when varying (32- 

To estimate the range of the effect, we study the correction to ex numerically. For the 
SM CKM part Vckm, we use the Wolfenstein parameterisation with A = 0.2253, A = 0.808, 
p = 0.132 and ry = 0.341. In terms of new physics parameters, we take account of tree level 
bounds which we discussed in previous section. Therefore, we vary new physics parameters 
within the ranges : < sin6'H < 0.3, \V^^\ < 0.078, \V^^\ < 0.2, |Vr^||Vr^| < 3.2 x 10-^ 
< /3i < 27r and < /32 < 27r. Here the upper bound values of |V^^| = 0.078 and 
|V^^| =0.2 correspond to case A and B respectively, and the parameter ranges of two new 
phases /?i and /32 in our model are not restricted by the present experimental results. The 
dependence of \eK\ in the vector- like model as a function of sin dji is shown in Figure ^ for 
three different values ofrrit' (350 GeV (blue), 500 GeV (green), 1000 GeV (red)). Deviations 
are typically at few percent level. The main source of the theoretical uncertainty is the 
bag parameter Bk- Note that the effect is always below the theoretical uncertainty in the 
matrix elements. 

IekI 

4 I 




0.1 



0.2 



0.3 



sin Qo 



Figure 3: Deviation of \£k\ in Vector-like model from the SM value is shown as a function of 
sm0R for three different values of mf (350 GeV (blue), 500 GeV (green), 1000 GeV (red)). We 
vary the other parameters within the ranges : \V^^\ < 0.078, \V^^\ < 0.2, < 3.2 x lO"'^, 

< /3i < 27r and < /32 < 27r. 



4.2 B meson sector: B^ — B^ mixing 

The mixing in the B meson sector can be computed in a similar way as the K^-K^ mixing. 
In this case AM^^ = 2|Mi2(5g)|, M^iBg) = |Mi2(Sg)|e'*S'J while the experimental value 
of AMb, is @ 

AMb^ = (3.337 ± 0.033) x 10-^^GeV. 
In the SM, the real and imaginary parts of Mi2(i?d) are given by the following forms 

ReMuiBd) = CB,VttE{xuXt)A^ {(1 - pf - rf] \\ (4.7) 
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ImMi2{Bd) = -2CB,ilttE{xu^t)A\l - p)r^\^ , (4.8) 

where Cb^ = i2^'>TT'BdfBci^d.^w- "^^^ leading contribution of Mi2{B(i) is the top-mediated 
box diagrams and ReMi2{Bd) is of the same order of magnitude as ImMi2{Bd). To check 
the leading contribution of Mi2{Bd) in the vector-like model, we expand in a power of 



Cb, I 



mj sin'* Or ~ 
H 4 E{xt',xt' 

- 2e^^^(v;,yi,)(F;,y,,)^|yi2|sin0^ 

{ ^, ^ Tn? ~, , mfsin^^R-, ,1 , 

X <^ E{xt,xt) i^E{xt,xt') \^ ^^ ^(xt/,xt/) } , (4.9) 

where E{xi,Xj) = rjf-E{xi,Xj). The function E{xt',xt') ^ x^/ grows with the t' mass, 
while the coefficient (■^^ )^ is suppressed by Consequently, deviations which comes 

from this effect are no more than m|/m^. Similarly, the top-t'-mediated box diagrams are 
also suppressed by a power of m^/rn'f, ~ m^/m^. Therefore these new physics effects are 
sub-leading terms in allowed parameter space. It is important to check the new physics 
effect which is caused by the modification of the CKM matrix. The contributions from the 
top-mediated diagrams are written as follows: 



ReMi2{Bd) = CB,VuE{xt,xt 



m? sm I 
) i 

2 



+2—\V^^\smeRA{{l-p)cos/32 + v sm ^2 } A 
mt 



(4.10) 



ImMi2{Bd) = -2CB,r]j^tEixt,xt 



6 



- — |V^2| sineRAUl - p) sin/32 - ??cos/32}A^ 
mt 



(4.11) 



The second term is proportional to due to ^ ~ 0{X^). Therefore, in the B'^ — B^ 
mixing, we find that new physics contributions are smaller than the SM ones. 

In the Bd system, numerical results are analogous to — mixing as typical differ- 
ence from the standard model value of AM^^ is in the few to 10% range. These values are 
below the theoretical uncertainty in the matrix elements. In our numerical calculations, we 
set r/^ = rjf^i = rjj^f/- Although this is not accurate, the discrepancy between our numerical 
results and the results including NLO QCD corrections is small because the top mediated 
box diagrams are the leading contributions in our model. We plot the real and imaginary 
parts of Mi2{Bd) for mf = 350,500,1000 GeV in Figure |. Ah the effects are typically 
small deviations with respect to the SM in the Bd system. 
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Figure 4: Real and imaginary parts of Mi2{Bd) for nit' — 350,500,1000 GeV. The Vector-like 
model is shown for three different values oisinOji (0.1 (blue), 0.2 (green), 0.3 (red)). The SM value 
is shown with a black cross. We set that < 0.078, < 9.2, |y^i||V"^2| < 3 2 x lO"'^, 

< /3i < 27r and < /32 < 27r. 

4.3 B meson sector: — B^ mixing 

The experimental value of AMb^ is 

AMb, = (1.170 ± 0.008) X lO^^GeV . (4.12) 

The real and imaginary parts of Mi2(i?s) in the SM can be "written as 

ReMu{Bs) = CB^7]ftE{xt, xt)A^\^ , (4.13) 
ImMuiBs) = 2CB,rjf,E{xt,xt)A^rjX^ , (4.14) 

where = ^^mBsfBs^siT^W- comparison "with the real part ReMi2{Bs), the imag- 
inary part ImMi2{Bs) is suppressed by a po"wer of A^. This is a remarkable feature of 
Bg — Bg mixing. Even though the ne"w physics effects to ReMi2{Bs) are small, there 
is some possibility of that ImMi2{Bs) is largely shifted by the new CP phases. In the 
vector-like model, Mi2{Bs) can be written as 

= {V:,vMe{x,,x,) + 2^^^^4^ (e{x,,x,)-E{x,,xA 

mf sin'* Or A 
m\ J 
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E{xt,xt) - ^E{xt,xt 



/2 2 



E{xt',xt') 



(4.15) 



It is found that the top-mediated box diagrams become leading contribution in the — 
mixing. The real and imaginary part of Mi2{Bs) due to the top-mediated box diagrams 
can be expressed analogously to the Mi2{Bd) as 



ReMuiBs) = CB^VuE{xt,xt) 



mi svo? I 

1 - 2— TT- 



m 



X 



A^\^ + '^\ I sin dn cos /32^A2 
mt 



ImMuiBs) = 2CB^VttE{xt,xt) 



1 



mt sin^ I 



m 



X 



rrin 



A'r^X' + — |y^^|sin0Rsin/32AA' 
mt 



(4.16) 



(4.17) 



In the imaginary part of Mi2{Bs), this shows that the new physics contributions are sizable 
effects in comparison with the SM prediction for \V^\ = 0.2 (case B), sihOr = 0.3 and 
/32 = ±f • It is found that the \V^\ and /3i dependences are negligible. This large effect 
completely vanish when (32 = 0,7r. In case A, the correction to ImMi2{Bs) cannot be 
large due to the small value of \V^^\ {\V^\ < 3.2 x W-^/\V^^\ with \V^^\ = 0.078). It is 
also found that the t' mass dependence of the imaginary part of Mi2{Bs) is quite small, 



because the second term in Eq. (4.17) is the leading new physics contribution and does not 
depend on the t' mass. In the real part of Mi2(-Bs), new physics effect is proportional to 
C(A^). Therefore this effect is at least smaller than the SM value by a factor of A. The 
numerical results of real and imaginary parts of Mi2{Bs) for mt' = 350, 500, 1000 GeV are 
shown in Figure ^. It is found that the deviations of ReMi2{Bs) are less than 5%, while 
the deviations of ImMi2{Bs) are about ±50% for sin^/j = 0.3. These numerical results 
agree well with the analytical results in Eq.s ( 4.16 ) and ( 4.17] ). 

In the Bg system deviations of AMb^ and the phase with respect to the SM are 
at few percent level for /3i = /32 = 0. When /3i = /32 = the phase $s in the vector-like 
model is very close to zero in both cases A and B. However the situation can be drastically 
different when f32 is non-zero, see Figure ^. Here we define the deviation of the phase $s in 
the vector-like model from the SM value as = ($7*^*= - $^^)/$SM, Yot p2 = \ (-f ), 
it becomes maximal (minimum) value in case B. The deviation of the phase A<I>s can be 
enhanced by ~ +40(+60)% for mt> = 350(1000) GeV and sinOR = 0.3 due to the large 
deviation of ImMi2{Bs). For f32 = — f , it becomes negative deviation ~ — 40(— 60)%. A 
large phase is naturally allowed within our vector-like model with a non-standard doublet 
of quarks. This feature is also present in other models beyond the SM. A detailed study of 
this feature, in particular in relation with the dimuon asymmetry in B'^ — B'^ mixing will 
be described in a separate paper. 

We also plot the ratio (^^jjI^^ in Figure ^, which is less affected by theoretical uncer- 
tainties. However the deviation with respect to the standard model is small (at most 1%). 
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Figure 5: Real and imaginary parts of Mi2{Bs) for mf — 350,500,1000 GeV. The Vector-like 
model is shown for three different values of smBj^ (0.1 (blue), 0.2 (green), 0.3 (red)). The SM 
value is shown with a black cross. We vary the other parameters within the ranges \V^^\ < 0.078, 
\V^^\ < 0.2, < 3.2 X 10-"^, < /3i < 27r and < /32 < 27r. 



4.4 Coupling of the Higgs to gluons and photons 

An important effect of new states that couple to the Higgs is to affect the loop-induced 
couplings to gluons and photons. Phenomenologically, this is of crucial importance at the 
LHC, because the main Higgs production mechanism is gluon fusion and, for low masses, 
the golden discovery channel is in two photons. Even though the new fermion could be 
heavy, the effect on the loop may be significant. 

We can easily calculate the effect on the loop by using the parameterisation proposed 
in ||2^: if we neglect the contribution of the light fermions, the only contributions will 
come from the couplings of the t' and from modifications of the top couplings. The two 
parameters can be written as: 

V V 

Kgg = K^^ = ^htt H hht't' — 1 ) (4-18) 

mt mti 

where hj^rj is the coupling of the Higgs with the fermion /. From Eq. (|2.32| ), we have 



Therefore: 



^..-=^-^V2'^V-, and K,, = ^-^V-^^V^,\ (4.19) 

= K,, = 1 - -V*,''vt' - ^Vl^'^Vk' = + . (4.20) 

™ mt ^ mt' ^ m\ 
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Figure 6: Deviation of in Vector-like model from the SM value is shown as a function of sin0/; 
for three different values of mf (350 GeV (blue), 500 GeV (green), 1000 GeV (red)). We vary the 
other parameters within the ranges \V^^\ < 0.078, \V^^\ < 0.2, jV^^^HT^^^I < 3.2x 10-^ < /3i < 27r 
and < ;32 < 27r. 
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Figure 7: Deviation of (^sjgf^j in Vector- like model from the SM value is shown as a function 
of sinOR for three different values of nif (350 GeV (blue), 500 GeV (green), 1000 GeV (red)). We 
vary the other parameters within the ranges \V^^\ < 0.078, \V^^\ < 0.2, |V|i||V^^| < 3.2 x 10""^, 
< /3i < 27r and < /32 < 27r. 



It is interesting to notice that this result is rather small, being proportional to the mixing 
with the light generations, and does not depend significantly on the new coupling of the 
top X3, as we may have naively expected. The reason for this is the following: if we take 



-26- 



the inverse of Eq. we obtain the relation 



MZ 



Vr 
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mt 



■V, 



L ■ 



(4.21) 



The component 44 of this matrix is 



44 



1 ^ 1 



L 



(4.22) 



i=l 



In the case of mixing only between top and new fermion, xi = X2 = 0, the relation reduces 
to 



(4.23) 



i=3,4 



This relation implies that k 



99 



vanish in the 2 fermion mixing case. Prom Eq. (l4ig| ), 



we can extract an upper bound on the k parameters. Using the relation |V^^P + Wr'\ 
— -i , we obtam 



A2\2\ 



(4.24) 



The upper bound is saturated by the maximal value of V^: this shows that loop effects are 
very small and therefore the Higgs phenomenology is the same as in the standard model. 



5. LHC phenomenology 

In the following we consider the LHC phenomenology for the decay of a heavy vector- 
like quark. Few promising decay modes are analysed and their relevance with respect to 
backgrounds is discussed. In this section we will present our numerical results for the 
benchmark values of the parameters in Table 0. The value of the mixing in particular 
is fixed to its maximal value allowed by precision measurements, while maximises the 
bound from the D^~D^ mixing. 





nif (GeV) 


sinOn 




vk' 


ruH 


(GeV) 


value 


350, 500 


0.3 


0.077 


0.0025 


120 


1000 



Table 4: Benchmark point values of the parameters. The ones with two values will be specified in 
each case. 



5.1 Decays 

The branching ratios for the decay of a heavy vector-like quark are quite different from 
those of a sequential fourth family and therefore this is an important physical characteristics 
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Figure 8: BR of t' as function of mf for the benchmark parameters in Table ^. The two panels 
correspond to a Higgs mass ruh = 120 GeV (left panel) and ruh decoupled from the spectrum (right 
panel). 

to distinguish the two different situations. The phenomenology is also novel as vector-like 
quarks can decay at tree level via neutral currents, to a SM fermions plus a Z/h, while a 
fourth generation quark can only decay via the W boson. A detailed and general discussion 
of the parameter and case dependence is given in appendix B2 of 0. Here, we will focus 
on the specific case of the non-standard vector- like doublet containing a new t' . In Figure 
m we show the branching rations for a light Higgs with = 120 GeV and for a decoupled 
Higgs (niH = 1000 GeV). All the other parameters are fixed to the benchmark values in 
Table § 

For light t' masses, below the tZ and th thresholds, 
the decay is dominated by the Wb channel, like for a 
fourth generation. However, after the th channel opens 
up, it quickly saturates to a BR of 50%, while tZ more 
slowly replaces Wb for large masses. This shows that 
the final states produced by the decays of the vector- 
like t' are very different from the ones typical of a fourth 
generation. The trend is similar in the case of a decoupled 
Higgs, apart for the absence of the th channel. Figure 9: Feynman diagram for 

the single production of t' at LHC. 

5.2 Single production 

The single production of t' takes place via flavour violating interactions of the Z and W. 
The W mediated channels are similar to the ones giving single top, however the mixing 
angles depend on the mixing matrix in the left-handed sector and they are very suppressed. 
Therefore, the production is dominated by the exchange, in t- and s-channel, of the Z boson 
depicted in Figure ^ where the grey blob represents the flavour violating coupling. Such 
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process is absent in the case of a fourth generation. The production cross-section is shown 
on the left panel of Figure as a function of mj/ for the benchmark parameters in Table |^. 
The dominant contribution comes from the t-channel exchange of the Z with a valence up 
quark in the initial state, therefore it is directly proportional to the mixing angle ■ The 
benchmark point we chose is characterised by a maximal V^^, therefore the values of the 
cross-section in the figure are the maximal values in this model. On the right panel, we also 
show the pair production cross-section as a function of mf/ : one important difference is that 
the single production cross-section decreases more slowly compared to the pair production 
and, for masses above 450 GeV it dominates at 7 TeV. In the following we will study in 
detail the single production case, which seems more promising at 7 TeV, and leave the pair 
production case for future investigation. 

In Table |, we listed the values of the cross-section and branching ratios in a few 
benchmark points that we will consider more in detail in the following. As the general 
mixing structure is taken into account, decays to first and second generation quarks are 
allowed and controlled by the mixing parameters. In the case sin^^j = 0, points 1-A and 
2-A, the mixing with the top vanishes, therefore the t' can only decay into a light quark 
plus Z jh. The decay into a is suppressed by the light quark masses. 





sin dR 


{mt',mh ) 
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Branching 


Ratios of t' 






(GeV) 


(fb) 


tz 


th 


Wb 


BP 1 


0.3 


(350, 120) 


691 


0.23 


0.51 


0.23 


BP 2 


0.3 


(350, 1000) 


691 


0.50 




0.49 


BP 3 


0.3 


(500, 120) 


254 


0.36 


0.50 


0.10 


BP 4 


0.3 


(500, 1000) 


254 


0.77 




0.23 










uZ 


uh 




BP 1-A 





(350, 120) 


436 


0.13 


0.87 




BP 2-A 





(500, 120) 


223 


0.06 


0.93 





Table 5: Benchmark points, production cross-section (a) and Branching ratios of t' for the results 
of LHC simulations. 

The production cross-sections and branching ratios have been evaluated with CalcHEP |2^] 
with CTEQ61 PDFs and the factorization scale set to be mf {2mt' for the pair production). 

As shown in Figure |8| the dominant decay mode of t' are t' — t- th (for a light Higgs) 
and t' —7- tZ. Therefore the possible signatures of single t' production at LHC are: 

1. — 7- bj£^ via the decay chains 

t' b£^v)Z{^ vu) , 

t'^bW{^lv) ^bi^^T] 

2. pp ^ b i^i^i^j via the decay chain 

t' ^ti^ biu)Z{-^ £+£-); 
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Figure 10: Production cross-section for a single pp — > t'j (left) and a pair pp — >■ t'F (right) of 
heavy quarks as a function of rrif for the benchmark parameters in Table |^ We consider various 
energy options for the LHC. 

3. pp —7- bbbj £^ via the decay chain 

t' tH{-^ hi) t{-^ biu)bb bib £ ; 

4. pp ^ b £^jjj via the decay chain 

In addition to these channels we have also considered a very interesting possibility when 
sinOn = 0. This corresponds to no- mixing between t and t' and hence the decay channel 
t' — >• tZ/h is closed and the dominant decay modes of t' are t' — )• uZ/h. 

In the following sections, we will discuss each of these signatures separately. 

5.2.1 Framework of event generation and analysis 

The setup used for signal and background event generation is the following: 

• Signal events: The partonic level signal events were generated by CalcHEP 2.5.6 
[p9|]. The partonic level events were then interfaced with PYTHIA 6.4.21 |30| via the 
LHE (Les Houches Event) interface in order to include ISR/FSR and hadronization. 

• Background events: The tt background was simulated using PYTHIA 6.4.21. 
The single top and Z + jets backgrounds were generated using ALPGEN 2.14 pl| . 
The backgrounds for the signature bji^i^i^ ^^^were generated using Madgraph |^2|. 



We have used a modified version of ATLFAST to reconstruct the jets and identify 
the isolated particles. Finally the events were analyzed within ROOT framework. For our 
analysis we have considered LHC with centre of mass energy of 7 TeV and an integrated 
luminosity of 10 fb~^. In our analysis leptons are intended to be only electrons and muons 
{£ = e,fi). 
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5.2.2 Signature pp t'{-^ tZ)j b ji^ 

This signature originates from two independent decay chains: 

The effective cross-section of this process is 



a X 



a X 



BR{t' tZ) X BR{Z vu) X BR{t bW) + BR{t' bW) 



BR{t' tZ) X 0.2 X 0.99 + BR{t' bW) 



X 0.2,, 



X BR{W iu) 



(5.1) 



where a is the single production cross-section. This indicates that, despite of BR{t' — t- tZ) 
being larger than BR{t' — )• bW) (refer to Figure the invisible branching ratio of the Z 
suppresses the former contribution to the effective cross section. For light masses m^/ < 500 
GeV, the bj£^ -^rsignature is therefore dominated by the Wb decays. 
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Figure 11: bji^ event distributions with respect to the pr (left) and rapidity (right) of the 
lepton at the LHC with centre of mass energy of 7 TeV and luminosity of 10 fb^^. 

As shown in Figure ^ the above decay modes are the dominant ones for heavy Higgs 
masses. Accordingly, to maximise the signal, we have estimated this signature using a 
Higgs mass of nih = 1000 GeV. For a light Higgs, the branching ratios (and therefore the 
number of signal events) are approximately halved. One of the advantages of this process 
is that there is only one b-jet to be tagged and large missing transverse energy (MET) 
from the neutrinos could allow us to distinguish the signal from backgrounds. 

In order to have an idea of the relevance of this channel at 7 TeV LHC we have 
perfomed a simplified analysis. The preselection cuts we used are: 

• Exactly one isolated lepton with transverse momentum > 15 GeV and rapidity 
{ril < 2.5. 
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Figure 13: bj£^ • event distributions with respect to the pT (left) and rapidity (right) of the 
b-jet at the LHC with centre of mass energy of 7 TeV and luminosity of 10 fb^^. 

• Exactly one b-tagged jet with pT > 20 GeV and Ir^l < 3. We assume a b-tagging 
efficiency of 60%. 

• Exactly one additional light jet with pT > 20 GeV and |r/| < 5. 

• Minimum MET threshold: > 30 GeV. 



The distributions after pre-selection cuts are shown in Figures |lj and |15[ An 

important feature of the distributions is that for signal events the pT of the light jet is 
relatively smaller than of the b-jet. On the other hand, the rapidity of light jet tends to 
be higher as compared to the b-jet. Another important feature is the distribution of the 
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Figure 14: bj£^ ■ (left) and Ht (right) distributions at the LHC with centre of mass 
energy of 7 TeV and luminosity of 10 fb~^. 
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Figure 15: bj£^ ■ Invariant mass distributions of the bottom b and lepton I at the LHC with 
centre of mass energy of 7 TeV and luminosity of 10 fb^^. 



invariant mass of the bottom quark and the lepton in Figure this quantity has been 
used in the CMS search for pair production of fourth generation quarks decaying into Wb 
to remove the top background [^6|. In fact, for a b and lepton from a top leptonic decay, we 
would expect the invariant mass to be smaller than the top quark mass. In Figure |l^ we 
can see that the tt and single top backgrounds do indeed peak below mtop- For the signal. 
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there is also a peak below the top mass coming from the Zt decay modes, while the Wb 
events leak above the top mass. A cut mu > 170 GeV could therefore help reducing the 
top backgrounds for small t' masses, while for large t' masses the decays are dominated by 



the Zt mode which is severely removed by this cut. As it can be seen from Figure 16, the 
two decay chains t' — )■ hW and t' — )• tZ can also be distinguished from the px of b-jet: the 
chain t' — >■ hW typically gives larger pT to the b-jet. The MET distribution can also be 
used for distinguishing the decay chains. The decay t' — )• bW typically shows larger MET 
as compared to t' — tZ. 

In order to further improve the significance of our results we have imposed the following 
secondary cuts: 

• p^T> 100 GeV, 

• mu > 170 GeV, 

• ^T> 100 GeV. 

The results of signal and backgrounds after the cuts mentioned above are shown in Table 
|6| and in Figure 15. The table shows that this mode is problematic at 7 TeV LHC. The 
reason is that the heavy vector-like quark masses explored here (up to 500 GeV) have a 
typical signature which is too close to the SM single top signal. We expect that higher 
mass vector-like quarks will be easier to disentangle from background because of a larger 
pT of the b-jet and larger MET, however due to the smaller cross-section these may be 
accessible only at higher centre of mass energy of higher luminosities at the LHC. 
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Figure 16: bje^^ : (left) and pt of the b-jet (right) distributions at the LHC with centre 
of mass energy of 7 TeV and luminosity of 10 fb^^ . The contributions of the Wb and Zt channels 
are plotted separately. 



5.2.3 Signature pp t'(^ tZ)j bi^£^£^ j 

The trilepton channel is regarded as one one of the golden discovery channels because of the 
low SM background and very low probability of faking it with jets. In our case, only one 
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Table 6: bj£^ ■ Number of signal events after the cuts at the LHC with centre of mass energy 
of 7 TeV and luminosity of 10 fh"^ . 




Figure 17: bji^P^l^ : Opposite sign dilepton invariant mass (m£+i-) distribution at the LHC 
with centre of mass energy of 7 TeV and luminosity of 10 fb~^ . The correct combination of leptons 
has been selected by minimising as defined in the text. 



tagged b-jet is required, hence it does not loose much on tagging efficiency. This signature 
is obtained from the leptonic decay of the Z boson: Z — )• . One can also associate the 
whole MET as originating from the decay of t and hence one can fully reconstruct the top 
and t' . For the analysis we have used the following pre-selection cuts: 

• Exactly three (two of same sign) isolated leptons with pT > 20 GeV and \r]\ < 2.5. 

• Exactly one b-tagged jet with px > 20 GeV and \ri\ < 3. We assume a b-tagging 
efficiency of 60%. 

• One additional light jet with pT > 20 GeV and < 5. 



-35- 



Requiring three charged lepton with sufficiently high pT helps in reducing the tt background 
where one of the lepton comes from the decay of the b-jet. 

We can reconstruct the Z-boson in dileptonic decay. We have three leptons in the 
final state and hence we can have two combinations of opposite sign dileptons. The correct 
combination can be chosen by selecting the one that minimise the quantity: 



To further reduce the backgrounds we impose that the invariant mass of the opposite sign 
dileptons should be close to mz- We have shown the opposite sign dilepton distribution in 
Figure 17. The results of signal and background events are given in Table ^. Our results 
show that it is indeed possible to probe t' in this channel at 7 TeV LHC with a luminosity 
of 10 fb-^ 



Cut 


BP 2 


BP 4 


BP 1 


BP 3 


SM 


Pre-selection 


14.4 


8.8 


6.5 


4.2 


20.7 


S/y/S + B 


2.43 


1.62 


1.25 


0.84 




\mf+f- — mz\ < 5 GeV 


13.6 


8.3 


5.7 


4 


3.8 


S/VS + B 


3.3 


2.4 


1.8 


1.43 





Table 7: bj£^£^£^ ■ Number of signal events after the cuts at the LHC with centre of mass 
energy of 7 TeV and luminosity of 10 fb"^. 



5.2.4 Signature pp t'{^ tH)j bbb ji^ 

This signature requires the presence of three tagged b-jets. This makes the detection of this 
signature challenging, especially at low energy and luminosities. The largest backgrounds 
to this channel might come from tt production where one of the light jets is misidentified 
with a b-jet. 

The additional problem in this channel comes because of the presence of three b-jets 
and hence, due to combinatorial background problems, it might be difficult to reconstruct 
the Higgs boson. 

5.2.5 Signature pp — ^ f(— ^ tZ)j — ^ b jjji^ 

Although this channel will probably have the highest effective cross-section (when we take 
BRs into account), one has to face the problem of the Z reconstruction. It would be possible 
to reconstruct the Z invariant mass using Z — )■ jj, however the reconstruction might not 
be very good because of the presence of an additional light jet in the event which will give 
rise to combinatorial backgrounds. Even if we were able to reconstruct Z, we may not be 
able to reduce backgrounds with W — )• jj as this too occurrs around the Z mass and the 
energy resolution with jets is typically not very good. Such backgrounds could possibly 
come from tt and it would be quite challenging to reduce them. 



-36- 



1 



l4TeV - 
STeV 
7TeV ■ 



800 1000 
m,. (GeV) 



0.8 



0.4 



uZ 



100 200 300 400 500 600 700 800 9001000 
m,. (GeV) 



Figure 18: Single production cross-section (left) and branching ratios (right) oft' as a function of 
nif for s\n6^ = 0. The remaining parameters are fixed at the benchmark values in Table^. 



5.2.6 Signature pp — )■ jH)j — )■ jjbb, in the case sin 6*^ = 0. 



The single production of t' in association with liglit jet has also been considered in |35| 
where they considered t' decays to be: 

t' W/Z + j 

with j=u,d and argued that this is the most general scenario. Here we showed that these 
modes are quite suppressed compared to decays into the third generation, due to the tight 
bounds from precision flavour measurements that limit the size of the couplings to light 
quarks. 

The situation is different only for sin 9^ = 
0: in this case, the heavy top t' decouples 
from the top, therefore it can only decay 
into light quarks. An important difference 
is the presence of the hj channel, that has 
not been considered in |3^]. In our spe- 
cific case, namely a non-standard doublet, 
the decays mediated by the W to light 
quarks are suppressed by the mass of the 
quark, therefore they are negligible. Fur- 



thermore, as we can see from Figure 15, 
the mode hj could be comparable to Zj 
especially for relatively large t' mass. The 
production cross sections are very similar 
to the previous case under consideration, 
as it can be seen from Figure |T^. 

In the rest of this section, we will fo- 
cus on the decay mode 

t' 




50 100 ISO 200 250 300 350 400 450 500 
pi (GeV) 



Figure 19: bbjj : pr of the higest pr light jet at 
the LHC with centre of mass energy of 7 TeV and 
lumionsity of 10/6^^. 



h + j. 
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Figure 20: bbjj : m^^ and Ht distributions at the LHC with centre of mass energy of 7 TeV and 
lumionsity of 10/6^^. 

Considering the dominant decay of /i — )• bb, we will get a signature of pp — )• t'j — )• jjbb. To 
study the bbjj final state, we impose the following preselection cuts: 

• Two light jets with pT > 20 GeV and |r/| < 5. 

• Two b-tagged jets with pT > 20 GeV and |r/| < 3. 

For this signature, we considered the background coming from Z and h + jets, with 



the bosons decaying into a bb pair, that has been generated with ALPGEN. In Figure |19 
we plotted the pT distribution of the highest px jet for signal and backgrounds. As can be 
seen from this distribution one can reduce the backgrounds by using a hard cut on the pT 



of the jet. In Figure 20 we also plotted the invariant mass ttij^j and total transverse energy 
Hj- distributions, where Ht is defined as the scalar sum of the transverse pT of the visible 
particles (jets and b-jets in our case). We can therefore improve the significance of this 
signature by imposing additional cuts: 

• Cut A : pPrp > 100 GeV. Hard cut on the px of the highest pT jet. 

• Cut B : \m^^i — mh\ < 25 GeV. 

• Cut C : Total transverse energy Ht > 300 GeV. 

• Cut D : Total transverse energy Ht > 350 GeV. 

In Table ^ we have shown the effects of the above cuts on signal and backgrounds. 
These results show that the backgrounds can be reduced and a a good significance achieved 
on the signal. 
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Cut 



Pre-selcction 



Cut A 



Cut B 



s/^/sTb 



Cut C 



Cut D 



s/^/sTb 



BP 1-A 



205.3 
0.75 



164.5 
1.5 



82.5 
3.4 



75.2 
3.7 



52.2 
3.2 



BP 2-A 



124.2 
0.5 



116.7 
1.1 



65.3 
2.8 



65.3 
3.2 



60.8 
3.6 



SM 



74500 



11440 



498.4 



341.7 



219.1 



Table 8: bbjj : No of signal events after the cuts 
for LHC with CM energy of 7 TeV and Luminosity 
oflOfb-'^. 



6. Conclusions 

We have discussed in detail new vector- 
like quarks which can mix with the stan- 
dard model quarks without conflicting 
with current experimental limits. In par- 
ticular we focused on a non standard 
doublet that contains a top partner and 
an exotic quark with electric charge 5/3. 
This case is motivated from models of 
composite Higgs, where such fermions 
are the lightest top partners, and from 
the less severe bounds from precision ob- 
servables on the general parameter space. 
In this paper, we discussed in detail the 
full flavour structure of the model in- 
cluding mixing with the light generations, and we studied the bounds on such mixing 
from flavour observables in the D meson sector and atomic parity violation measurements. 
We also studied their suppressed loop contribution to the mixing in the Kaon and B meson 
sectors, where large effects may appear especially in the CP violating observables. While 
all other effects are smaller than the theoretical uncertainty on the form factors, we found 
a potentially large effect on the phase of the Bg mixing amounting to a correction up to 
±150% of the Standard Model phase. We also considered the new bounds from the recent 
data at the LHC with a luminosity of up to 1 fb^^: the bounds arc lower than the nominal 
ones due to the reduced branching ratio in the final states analysed by the collaborations, 
therefore masses as low as 300 or 380 GeV are still allowed. 

In the second part of the paper, we considered some LHC signatures of this scenario. 
In particular, we focused on single production of the heavy top partner due to the flavour 
violation couplings of the Z boson: this channel is dominated by up-quark initiated pro- 
cesses. Notwithstanding the suppressed coupling, the cross section is enhanced by the large 
PDF's of the valence ups, and it can dominate over the pair production channel at large 
masses, about ~ 400 GeV. We performed a detailed simulation of signals and backgrounds 
for a few benchmark points. For generic parameters, the preferred decay flnal states involve 
W, Z and Higgs plus third generation quarks. The most promising channels contain at 
least one lepton in the final state from the top or W decays. The main background for 
these channels is given by events containing top quarks. We identified the most promising 
final state as bji^i^i^ ^t- For light t' masses, however, the top backgrounds have very 
similar kinematic structure as the t' signal, therefore it is very hard to disentangle the 
signal events and an integrated luminosity of 10 fb~^ at 7 TeV of centre of mass energy 
may not be enough for the discovery. The LHC with a higher centre of mass energy and 
good luminosity can improve the situation, especially by accessing higher mass cases where 
the distinction is possible if enough events are collected. 

Finally, in the case of no mixing with the top quark, the t' decays mostly into a light 
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Higgs plus a jet: this channel would generate the final state bbjj. By imposing cuts on the 
invariant mass of the b-tagged jet pair and on the total transverse energy, it is possible to 
reduce the backgrounds and discover this channel with luminosities below 10 fb~^. 

Our exploration showed that the phenomenology of vector-like fermions can be very 
rich, and many other channels, not considered here, deserve further detailed investigation. 
Moreover, a generic model independent analysis of the parameter space, not biased by any 
specific model, is crucial at this point of the LHC as it would allow us to fully exclude this 
possibility or, in case of excesses in the data, it would offer hints on the kind of new physics 
at the TeV scale. 
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A. Appendix: Expansion of the CKM matrix 



We give in the following a systematic expansion of the CKM matrix in our modified frame- 
work, including the extra vector-like top partner. The mixing angles in the left-handed 
sector are small, and we can safely assume that the main structure of the CKM matrix is 
coming from the SM Yukawas, therefore Vckm is very close to the measured CKM matrix. 
A simple way to estimate the impact of the mixing in the left-handed sector is to use the hi- 
erarchy in Vckm and the quark masses in terms of the Cabibbo angle A = sin0i2 = 0.2252, 
where 9i2 is the mixing angle between the first and second generation. It is well known that 
the SM CKM matrix is hierarchical: we will use here the Wolfenstein parameterisation B 



Vr 



CKM 



( I-A72 A A\^{p-ir]) 

-A I-A72 AX^ |+0(A^) 

\^A\^{1- p-ir]) -A\^ 1 



/ 0{\) 0{\^)' 

0{\) 0{l) 0(A2) 
\0(A3) 0(A2) 



The hierarchy in the quark masses can also be related to the Cabibbo angle, ^ ~ 0{X 



and ^ ~ 0{y), therefore one can also determine a hierarchy in the matrix Vl'- 

Vl ~ 0(A4) 0(A3) . (A.l) 

\0{\^) 0{\^) 0{l) ] 

Note that the powers of A only take into account the suppression coming from the quark 
masses, and that additional suppressions will come from the small mixing with the vector 



fermions, as discussed in Section 3.8. Using the expansion in powers of A, we can order the 
contributions to the elements of Vckm = Vj^ ■ Vqj^^j. Moreover, we will explicitly indicate 
the phases of the new Yukawas xi and X2 to make clear where the new phases enter while 
the SM phase is hidden in the standard CKM elements Vqqf. 

Vckm = Vud[X'] + e^^^^-^-^\Vl'\Vd[X'] + e-'^-\Vl'\Vtd[X''] , 
VckM = Vus[X^] + e'^''^-M\vmVs[X']+e-"'^\Vl'\Vts[X''] , 
Vckm = Vub[X'] + e'^^^-Mlvl^lv^^iX^] + e-'^^\Vl'\Vtb[X-'] , 

Vckm = KdlA^] - e-^(^^-^-)\Vl'\VUX'] + e-^f^^\Vi'\VUX^] , 

Vckm = VsiX^] + i-e-^^^'-^^^\VP\Vus + e-^^^\Vl^\Vts)[X^] , (A.2) 

VS'km = VcbiX''] + e-^^^\Vl^mX'] - e-^^P^-P^^lVPlVubiX-'] , 

VSUi = VPVu[X'] - e^^^Vl'\V,,[X'] - e^^^VPlVUX'] , 
VS'km = VPVs[X'] - e^^^lVl'mX'] - e^^^\Vl'Ks[X'] , 
VS'km = VPV.iX'^] - e^^-\VPmX'] - e^^^lVl^mX'''] ; 
in square brackets we give the power counting in A for each term. Analogously, one can 
calculate the couphngs of t' to the W (taking into account that V^^ ~ C'(A^), V^*^ ~ 0{X^) 
and _ 0(1)). 

VSU = Vi^VtdiX^] + e^^^\Vl^\V,d[X^] + e^f'-lVl^lVUX'] , 

vSkM = Vl^'VtsiX^] + e^^'lVl^lVcsiX^] + e^^^\Vl^\Vus[X^] , (A.3) 

vS'km = VE^'VtkiX^] + e^^^\Vl^\V,,[X^] + e^^^lVl'^mX^^] . 
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B. Appendix: Notation for the meson mixing 



The — mixing can be calculated in our model with an extra non-standard doublet 
by a simple generalisation of the usual formulas, by including the effect of the t' quark 
as shown in Figure |. The effect ive Hamiltonian describing — mixing is a simple 
extension of the standard one and it is given by 

Gp 



n 



a 



eff 



47r sin^ Ow 



(B.l) 



with 



E(^Xi , Xj 



X i X j 



+- 



log Xi 



4{l - Xi){l - Xj) {xi - Xj){l - 

log Xj 



2x. + ^ 



1 




for i 7^ j. For i = j the Inami-Lim function E(xi^Xj) becomes 

3xf log Xi 



E(^Xi , Xi^ 



(l-x,) 



.^2 



llXi xf 

^T'^T 2(1 



(B.2) 
(B.3) 

where rjij are QCD corrections to the Inami-Lim functions, C = ^ckm^ckm ^^'^ ^« ~ 
"''f/^'VF' ^CKM^CKM leads to the quadrangle condition ^" + .^'^-1-^* + .^*' = 0. We checked 
these formulas by calculating the loop box diagrams in Feynman-'t Hooft gauge: in the 
mass eigenstate basis, the couplings of the W bosons are given in Eq. ( 2.23 ). 
The hadronic matrix element entering the K^~K^ mixing is 



{K^\ [s^^PLd][srPLd\ = -flBKml (B.4) 

where fx ~ 160 MeV is the Kaon decay constant, its mass is mx = 497.614 it 0.024 MeV 
and Bk = 0.725 it 0.026 |36| is the bag parameter. In the non-SM doublet model, the 
mixing matrix element M12 becomes 

1 



12 



2mK 



{K-\n,ff\K- 



-fKBKmK-7=- — — 
o v2 47rsm t'ly 



mjeeE{xi,xj).{B.f>) 



i,j=c,t,t' 

Here we are interested in two CP violating quantities: the mass difference Amx be- 
tween the two mass eigenstates Kp/g, and the direct CP violation parameter ex, defined 
in terms of the matrix element as 

ArriK = 



rriKj^ — fTLKg = 2|Mi2| ^ 2ReMi2 , 

g«7r/4 



-ImMi2 . 



\/2AmK 

With the non-SM doublet we consider, Amx is given by 

l,j = C,t,t' 



(B.6) 
(B.7) 

(B.8) 
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the can be expressed as (where we show the ordering in powers of A) 

The formulas in this section can be easily generalised to the case of Bg and mixing: 
it is enough to replace the s quark with a h and the d quark with a s or d respectively. The 
relevant CKM entries in the two cases will be 

es = V*c^i^MyifKM and ^^ = y^^W/.M (B.9) 

with i = u, c, t, t' . 
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